Plan testing and evaluation processes Evidence Guide

NTISthis.com

Evidence Guide: DEFTE001A - Plan testing and evaluation processes

Student: __________________________________________________

Signature: _________________________________________________

Tips for gathering evidence to demonstrate your skills

The important thing to remember when gathering evidence is that the more evidence the better - that is, the more evidence you gather to demonstrate your skills, the more confident an assessor can be that you have learned the skills not just at one point in time, but are continuing to apply and develop those skills (as opposed to just learning for the test!). Furthermore, one piece of evidence that you collect will not usualy demonstrate all the required criteria for a unit of competency, whereas multiple overlapping pieces of evidence will usually do the trick!

From the Wiki University

DEFTE001A - Plan testing and evaluation processes

What evidence can you provide to prove your understanding of each of the following citeria?

Identify testing requirements and undertake scoping

Critical analysis of the need for testing is conducted in accordance with organisational policy and procedures
Definition study is undertaken, where necessary, to determine scope of testing process
Scoping is completed in accordance with organisational policy and procedures, and identifies a rationale for the testing that includes the purpose and outcomes
Stakeholders are identified and canvassed to ensure that their requirements are addressed in planning

Critical analysis of the need for testing is conducted in accordance with organisational policy and procedures

Completed
Date:

Teacher:

Evidence:

Definition study is undertaken, where necessary, to determine scope of testing process

Completed
Date:

Teacher:

Evidence:

Scoping is completed in accordance with organisational policy and procedures, and identifies a rationale for the testing that includes the purpose and outcomes

Completed
Date:

Teacher:

Evidence:

Stakeholders are identified and canvassed to ensure that their requirements are addressed in planning

Completed
Date:

Teacher:

Evidence:

Determine testing methodology

Research and analysis is undertaken to identify impacts and risks, constraining factors and alternate options
Methodology technical feasibility, supportability and cost effectiveness are analysed and outcome is reported to key stakeholders
Alternatives for testing design are assessed and preferred option that fits organisational requirements is identified and reported
Relevant specialists are consulted to determine extent of potential risks
Business case is prepared and approvals to proceed with test development are obtained in accordance with organisational policy, procedures and guidelines

Research and analysis is undertaken to identify impacts and risks, constraining factors and alternate options

Completed
Date:

Teacher:

Evidence:

Methodology technical feasibility, supportability and cost effectiveness are analysed and outcome is reported to key stakeholders

Completed
Date:

Teacher:

Evidence:

Alternatives for testing design are assessed and preferred option that fits organisational requirements is identified and reported

Completed
Date:

Teacher:

Evidence:

Relevant specialists are consulted to determine extent of potential risks

Completed
Date:

Teacher:

Evidence:

Business case is prepared and approvals to proceed with test development are obtained in accordance with organisational policy, procedures and guidelines

Completed
Date:

Teacher:

Evidence:

Develop test and evaluation plans

Aims, objectives and impacts are defined in test plan and timeframes, and resources are identified to complete quality deliverables on time and within budget
Test methods are determined by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures
Testing outcomes are recorded in measurable and achievable forms, and indicators to monitor test performance are developed and agreed by relevant parties
Potential risks are investigated and identified in the plan and a risk management process is established to analyse information and options to manage risks
Skills, roles and responsibilities of team members and stakeholders are clarified and agreed, and reporting requirements are identified
Management of test parameters is addressed in the plan and evaluation criteria are designed in accordance with organisational policy and procedures
Management tools are utilised for planning in accordance with test requirements and the process is designed and documented, in consultation with specialists, to meet user requirements

Aims, objectives and impacts are defined in test plan and timeframes, and resources are identified to complete quality deliverables on time and within budget

Completed
Date:

Teacher:

Evidence:

Test methods are determined by consideration of resource constraints, environmental constraints, evidence requirements, existing capabilities and their compatibility with existing procedures

Completed
Date:

Teacher:

Evidence:

Testing outcomes are recorded in measurable and achievable forms, and indicators to monitor test performance are developed and agreed by relevant parties

Completed
Date:

Teacher:

Evidence:

Potential risks are investigated and identified in the plan and a risk management process is established to analyse information and options to manage risks

Completed
Date:

Teacher:

Evidence:

Skills, roles and responsibilities of team members and stakeholders are clarified and agreed, and reporting requirements are identified

Completed
Date:

Teacher:

Evidence:

Management of test parameters is addressed in the plan and evaluation criteria are designed in accordance with organisational policy and procedures

Completed
Date:

Teacher:

Evidence:

Management tools are utilised for planning in accordance with test requirements and the process is designed and documented, in consultation with specialists, to meet user requirements

Completed
Date:

Teacher:

Evidence:

Promulgate and maintain test plans

Security and confidentiality of data is maintained in accordance with workplace and regulatory requirements
Test plans are promulgated as required in accordance with organisational policy and procedures
Test plans are maintained in accordance with test and evaluation requirements, and organisational policy and procedures

Security and confidentiality of data is maintained in accordance with workplace and regulatory requirements

Completed
Date:

Teacher:

Evidence:

Test plans are promulgated as required in accordance with organisational policy and procedures

Completed
Date:

Teacher:

Evidence:

Test plans are maintained in accordance with test and evaluation requirements, and organisational policy and procedures

Completed
Date:

Teacher:

Evidence:

Assessed

Teacher: ___________________________ Date: _

Signature: ________________________________________________

Comments:

Instructions to Assessors

Evidence Guide



Critical aspects for assessment and evidence required to demonstrate competency in this unit	Nil Consistency in performance Competency should be demonstrated over time and should be observed in a range of actual or simulated work contexts.

Context of and specific resources for assessment	Context of assessment Competency should be assessed in the workplace or in a simulated workplace environment. Specific resources for assessment Access is required to: computer and relevant software legislation, guidelines, procedures and protocols relating to test and evaluation processes testing plans workplace documentation.

Guidance information for assessment	In all cases, assessment should be supported by questions to assess required knowledge and those aspects of competency which are difficult to assess directly. Questioning techniques should suit the language and literacy levels of the candidate. Assessment methods should reflect workplace demands such as literacy and the needs of particular groups Assessment methods suitable for valid and reliable assessment of this unit may include, but are not limited to, a combination of: authenticated evidence from the workplace and/or training programs case studies demonstration feedback from supervisors and peers regarding the candidate's ability observation portfolios projects questioning reviews or reports prepared by the candidate scenarios simulation or role plays.

Required Skills and Knowledge

This describes the essential skills and knowledge and their level, required for this unit.

Required Skills

access/prepare information electronically or in hard copy

apply risk management techniques

communicate with stakeholders using a range of communication styles to suit different audiences and purposes

detail requirements, write recommendations and prepare plans requiring precision of expression

include workplace safety issues in planning requirements

negotiate timelines, roles and responsibilities with stakeholders and team members

schedule testing activities

use management tools suited to planning testing processes

use planning techniques related to testing and evaluation that may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control

use public relations strategies to promote and gain endorsement

Required Knowledge

approval processes

integrated logistics support

legislation, organisational policy and procedures that may impact on the test and evaluation process

management tools suited to implementing testing processes

organisational change management

principles relating to the implementation phase of testing processes

resource plans

resource scheduling packages

test and evaluation implementation methods which may be complex in terms of scope; degree of risk; environmental, political, cultural and social factors that apply; consequences of failure; degree of control

work breakdown structures (WBS)

Range Statement


The Range Statement relates to the Unit of Competency as a whole. It allows for different work environments and situations that may affect performance. Bold italicised wording in the Performance Criteria is detailed below.
Critical analysis may include	Cost-benefit analysis Internal and external environment scan Operational imperatives Policies likely to be impacted Political imperatives Previous activities that may affect testing requirements
Organisations may include	Defence Defence contractors and sub-contractors Defence Materiel Organisation Defence Science and Technology Organisation International test agencies Universities
Policy and procedures may include	Relevant commonwealth, state/territory and local legislation affecting organisation's administration such as: financial management, and accounting legislation and regulations occupational health and safety (OH&S) legislation public sector management acts Government and organisational policy, guidelines and procedures relating to: delegation approvals industrial agreements procurement guidelines resourcing risk management security strategic or operational plans technical and regulatory framework testing and evaluation training
Stakeholders may include	Clients or customers (internal and external) End user/s General public Industry Landowner/s Organisation's senior management Other agencies Other functional areas within the organisation Project teams Relevant interest groups Sponsor/funding bodies Steering committee members Supplier/service provider Unions
Constraining factors may include	Cultural Environmental Financial Industrial Legislative Logistical support Operational Political Resources Safety Security/privacy Social Technical
Potential risks may include	Financial Probity Security Scheduling Technical
Approvals may include	Business owner Chief executive officer, manager or management representative Customer or client Environmental authorities Funding body Line manager Program manager Regulatory authority Specialist management office Testing sponsor
Test plans may include	Acquisition strategies Budget and financial management strategy Contract management Cost estimates Evaluation criteria Expected/measurable outcomes Facilities Functional performance specifications Governance strategy Implementation strategy Inclusions and exclusions Information/communication strategy Intellectual property strategies Milestones Objectives Occupational concept document People plan including human resource management and human resource development Performance criteria/indicators Purpose Quality assurance Quality control Quality standards Rationale Required resources Resource management Risk management Roles and responsibilities Safety criteria Schedule/timeline Specific equipment, instrumentation, and/or specialised facilities and required conditions Task/WBS Test and evaluation master plan (TEMP) criteria Test concept document Testing control mechanisms Testing deliverables and their acceptance criteria
Options to manage risks may include	Acceptance Avoidance Minimisation Transfer
Management may include	Change management Communication, including reporting Financial management Logistics management OH&S management People management Procurement management Quality management Resources management Risk management Schedule management Scope management
Parameters may include	Acquisition/procurement Change management Communications including reporting requirements Cost Delivery requirements Evaluation Feasibility Governance structure Integration of testing within organisation Intellectual property Monitoring through testing processes Operational flexibility Organisational structure People required for test including specialist expertise Pilot outcomes Quality control Resources Risks associated with test including people, environment, resources, technology change during the life of the process (if applicable) Scope including outcomes, objectives, deliverables Skills required for testing team Steering committee arrangements Timeframe and milestones Transition arrangements
Management tools may include	Communications plan Life cycle cost analysis Logistics support analysis Organisational testing governance framework Recording systems - electronic and manual Reporting framework Risk analysis Test and evaluation management software and other tools: cost schedule control system critical path method Gantt and bar charts program evaluation and review technique (PERT) charts spreadsheets
Specialists may include	Environmental Financial Legal Logistics Operators Other functional areas Other relevant agencies Regulatory Safety Technical

NTISthis.com

Evidence Guide: DEFTE001A - Plan testing and evaluation processes

Student: __________________________________________________

Signature: _________________________________________________

Tips for gathering evidence to demonstrate your skills

DEFTE001A - Plan testing and evaluation processes

Identify testing requirements and undertake scoping

Determine testing methodology

Develop test and evaluation plans

Promulgate and maintain test plans

Assessed

Teacher: ___________________________________ Date: _________

Signature: ________________________________________________

Comments:

Instructions to Assessors

Teacher: ___________________________ Date: _